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Several important properties of positive semidefinite processes of Ornstein-Uhlenbeck type are 
analysed. It is shown that linear operators of the form X i— > AX + XA T with A € Md(K) are the 
only ones that can be used in the definition provided one demands a natural non-degeneracy con- 
dition. Furthermore, we analyse the absolute continuity properties of the stationary distribution 
(especially when the driving matrix subordinator is the quadratic variation of a d-dimensional 
Levy process) and study the question of how to choose the driving matrix subordinator in order 
to obtain a given stationary distribution. Finally, we present results on the first and second order 
moment structure of matrix subordinators, which is closely related to the moment structure of 
positive semidefinite Ornstein-Uhlenbeck type processes. The latter results are important for 
method of moments based estimation. 
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1. Introduction 

Positive semidefinite Ornstcin Uhlcnbcck type processes are a special case of Ornstein- 
Uhlenbeck (OU) type processes (see, e.g., [15, 32]) that take on only values in the positive 
semidefinite matrices. 

They were first introduced in [6] as the solution of the stochastic differential equation 

c\Z t = (AZ t -+^A T )dt + dL t (1.1) 

with A being a d x d-matrix, L a matrix subordinator (see [3]) and the initial value 
So a positive semidefinite matrix. Matrix subordinators are a generalisation of the one- 
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dimensional concept of Levy subordinators (see [30]) and are simply Levy processes that 
take on only values in the positive semidefinite matrices. As a stochastic process in the 
positive semidefinite matrices, such an OU type process can be used to describe the 
random evolution of a covariance matrix over time (that is why we denote it by £). In 
particular, it can be used to define a multidimensional extension of the popular stochastic 
volatility model of Barndorff-Nielsen and Shcphard [4] (sec [25] for details). 

In this paper we analyse several important properties of positive semidefinite OU type 
processes. After briefly reviewing these processes in Section 2, we start in Section 3 by 
showing that linear operators A on the symmetric matrices of the form X i— ► AX + 
XA T with a d x d matrix A are the only ones whose exponential e A * maps the positive 
semidefinite matrices onto the positive semidefinite matrices at all times t 6 R + . This 
implies that these operators are the natural class to be used in the definition of positive 
semidefinite OU type processes. Thereafter we analyse absolute continuity properties of 
the stationary distribution in Section 4.1. In particular, we show that the stationary 
distribution is absolutely continuous and, hence, concentrated on the strictly positive 
definite matrices if one uses the discrete quadratic variation of a rf-dimcnsional Levy 
processes with absolutely continuous Levy measure as the driving matrix subordinator 
(whose Levy measure is thus concentrated on the rank one matrices). Moreover, we 
generalise and refine a result of [1] for multivariate OU type processes in Section 4.2. It 
allows one to compute the characteristic function of a matrix subordinator leading to a 
given stationary distribution of the OU type process. In connection to this we show also 
that the stationary solution of (1.1) may be living on the positive semidefinite matrices, 
although the process L is not a matrix subordinator. This is a very interesting difference 
from the univariate case, where a stationary OU type process can only be positive at all 
times if it is driven by a subordinator. 

Finally, we aim in Section 5 at characterising the first and second order moment struc- 
ture (i.e., the mean and covariance matrix) of matrix subordinators in general. Since 
the first and second order moment structure of OU type processes is a function of the 
mean and covariance matrix of the driving Levy process and the drift parameter (i.e., 
the matrix A above), this characterisation is especially important when one wants to 
(semi-parametrically) estimate the drift and driving matrix subordinator of a positive 
semidefinite OU type process or a related stochastic volatility model using a method 
of moments based estimator. Such estimation techniques are very popular in the uni- 
variate case (see, e.g., [4]) and have been successfully used in the multivariate case in 
[25], for which our results provide the necessary theoretical foundations. We completely 
characterise in linear algebraic terms the possible first and second moments of diagonal 
matrix subordinators, i.e., matrix subordinators whose off-diagonal elements are zero. 
This immediately translates to the first and second moments of the diagonal elements of 
general matrix subordinators, for which we so far have not been able to derive a complete 
characterisation of the possible first and second moments. Finally, we show that for the 
discrete quadratic variation of certain classes of <i-dimensional Levy processes, which are 
of a normal mixture type, the first and second moment can be calculated explicitly in 
general and that they have a form particularly suitable for further analysis. 
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1.1. Notation 

Throughout this paper we write R + for the positive real numbers including zero, R ++ 
when zero is excluded and we denote the set of real n x n matrices by M n (E) , the group 
of invertible n x n matrices by GL n (M), the linear subspace of symmetric matrices by 
S n , the (closed) positive semidefinite cone by §+ and the open (in S n ) positive definite 
cone by §^ + . I n stands for the n x n identity matrix and a (A) for the spectrum (the 
set of all eigenvalues) of a matrix A € M n (R). The natural ordering on the symmetric 
nx n matrices is denoted by <, that is, for A, B € S n we have that A< B, if and only if 
B — A £ §+ . The tensor (Kronecker) product of two matrices A, B is written as A g) B . vec 
denotes the well-known vectorisation operator that maps the n x n matrices to 1" by 
stacking the columns of a matrix below one another. For more information regarding the 
tensor product and vec operator we refer to [13] , Chapter 4. Likewise vech : Sd — > R d ( d+1 )/ 2 
denotes the "vector-half" operator that stacks the columns of the lower triangular part 
of a symmetric matrix below one another. The standard basis matrices (i.e., the matrices 
which have only zero entries except for a single one in the zth row and jth column) of 
Md(M) are denoted by £™ for i, j = 1, 2, . . . , d. Finally, A T is the transpose of a matrix 
A £ M„(R). For a matrix A we denote by Aij the element in the ith row and jth column 
and this notation is extended to processes in a natural way. 

Regarding all random variables and processes we assume that they are defined on a 
given appropriate filtered probability space (O,^ 7 , P, (J^t)) satisfying the usual hypothe- 
ses. 

Norms of vectors or matrices are denoted by || • ||. If the norm is not specified further, 
then it is irrelevant which particular norm is used. 

Furthermore, we employ an intuitive notation with respect to the (stochastic) inte- 
gration with matrix- valued integrators referring to any of the standard texts (e.g., [27]) 
for a comprehensive treatment of the theory of stochastic integration. Let (L t ) tS z^+ in 
M n>r (R) be a semimartingale and (A t ) teR + in M mjn (R), (B t )teR+ m M rjS (M.) be adapted 
integrable (w.r.t. L) processes. Then we denote by J Q A s dL s B s the matrix Ct in M m>s (M.) 
which has ijth element 

n r „t 

Cjj,t = ^ / Aik tS Bij tS dLki iS . 

fc=l 1=1 J ° 

Equivalently, such an integral can be understood in the sense of [23], resp. [22], by 
identifying it with the integral / Q A s dL s , with A t being for each fixed t the linear 
operator Af„ jr (R) — * A/ miS (R), X i— > A t XB t . Moreover, we always denote by with a £ 
RU {— oo}, 6el the integral over the half-open interval ]a, b] for notational convenience. 
If b = oo the integral is understood to be over ]a,b[. 

For a set A the indicator function is denoted by I a and the function log + is defined 
as log + (x) = max(log(x),0). 
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2. Positive semidefinite OU type processes 

In this section we briefly review the definition of positive semidefinite OU type processes 
(see [6]) and some of their elementary properties which are relevant for our results later 
on. 

The construction of these processes is based on a special type of matrix-valued Levy 
process (see, e.g., [30] for a comprehensive exposition of Levy processes in general), viz. 
matrix subordinators, studied in detail in [3]. An S^-valued Levy process L = (£ t ) tgR + 
is said to be a matrix subordinator if L t — L s £ §J for all s,t £ R + with t > s. It is 
S^-increasing and of finite variation. 

Let L be a d x d matrix subordinator, A £ M<j(R) and So £ §j~. Then the solution to 
the stochastic differential equation of OU type 

dS t = (A£ t _ + S t _ A T ) dt + dL t 

is given by 

£ t =e A %e AT *+ f e A ^dL s e AT ^- s \ 
Jo 

Note that the drift term simply is the linear operator A : — > S^, X i— > AX + XA T 
applied to S t _. Since the increments of L are positive semidefinite and it holds that 
e At (§J) = §J for all t £ R, the solution stays in §J for all times and is therefore called a 
positive semidefinite OU type process. Provided £'(log + ||£i||) < oo and cr(A) c (— oo,0) + 
iR, the above SDE has a unique stationary solution rcprcscntablc as 




Next we provide a characterisation of the stationary distribution of the positive 
semidefinite OU type process. To this end observe that tr(X T y) (with X, Y £ M(j(R) and 
tr denoting the usual trace functional) defines a scalar product on Md(R) (respectively, 
§d). Moreover, note that the vec operator links the scalar product on M<j(R) with 
the scalar product on R d via tr(X T y) = vec(X) T vec(Y) and that the norm on Md(R) 
induced by this scalar product is the Frobenius norm. 

This, in particular, implies that the driving matrix subordinator L at time t £ R + has 
characteristic function (cf. [3]) 

(2.1) 

Z£$ d , where Vi(^):=itr( 7L Z)+ / ( e itr ( xz ) - l)v L (dX) 

JS+\{0} 

with 7^ £ §^ and being the Levy measure, which is concentrated on §~f and satisfies 

/ min(||x||, l)i/i(dx) < oo. 
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Provided E(\og + ||Li||) < oo and <r(A) c (— oo,0) + iR, the stationary distribution of 
the positive scmidcfinite Ornstein Uhlcnbeck process £ is again infinitely divisible with 
characteristic function 



= exp Qf °° Me ATs Ze As ) ds^j 



cxp(itr( 7s Z)+ / (e itr ^-l)^(dX)Y ZeS d , 
Js+\{0} J 



(2.2) 



where 



and 



7s = -A- X 7L (2.3) 

ME)= I" [ I E (.e As xe ATs )v L (dx)ds (2.4) 
Jo Js+\{o} 

for all Borel sets E in §J \ {0} with Ie denoting the indicator function of the set E. 

Assume that the driving Levy process is square-integrable. Then the stationary second 
order moment structure is given by 

S(S t ) = 7s -A- 1 f yis L (dy) = -A- 1 E(L 1 ), (2.5) 

POO 

var(vec(S t )) = / ^ A ^+ I ^ A K a r(yec(L 1 ))^ AT ^ +I ^ A ^ t dt 
Jo 

= -^"Var^ec^i)), (2.6) 

cov(vec(£ t+fc ), vec(St)) = e( A ® Jd+/ '® A >Sar(vec(E t )), (2.7) 

where t 6 R and h G R+ and A : M d 2 (R) -> M d i (R), X h-> (A ® I d + I d <g> A) A + A(A T <g> 
Z d + / d <g)A T ). 



3. The possible linear operators 

So far linear operators A : E> d — ► of the form X i— > AX + Xy4 T with A € ilid(R) have 
been used seemingly ad hoc in the definition of positive semidefinite OU type processes. 
Obviously one can use any linear operator A which satisfies e At (§J) C §J and one 
would thus like to completely characterise these linear operators. However, this appears 
unfortunately impossible, because it is a very intricate unsolved problem to characterise 
all linear operators mapping to §J but not onto (cf. [16, 24]). In the following we show, 
however, that linear operators of the form X i— > AX + XA T are the only possible ones if 
one demands e At (§J) = Sj. The latter condition ensures that we have a non-degenerate 
situation in the following sense: On the one hand, it means that E t can take any value in 
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§J by changing the initial value £o as long as the Levy process does not jump. On the 
other hand, it obviously implies that the stationary distribution of a positive semidefinite 
OU type process cannot be concentrated on a proper subset of for a driftless Levy 
process unless the Levy measure of the matrix subordinator is concentrated on a proper 
subset (combine (2.4) and arguments analogous to [30], Theorem 24.10). Hence, the 
linear operators of the form X i— > AX + XA T are a natural class to use in the definition 
of positive semidefinite OU type processes. 

Before giving a technical lemma from which our result will follow, it is important to 
note that the linear operator A is uniquely characterised by the matrix A. 

Proposition 3.1. Let A,C G Mj(M.). Then the linear operators A : § d — > §d , X *— > AX + 

XA T and C : §d — ■> §^ , X i— > CX + XC T are the same, if and only if A — C. 

Moreover, for any operator A:Sd — > E>d,X i— > AX + XA T the matrix A is already 
uniquely identified by the values {AEW}j = i rii j, 

Proof. It suffices to show the second claim that {AJ?(*^}i = i <j already uniquely char- 
acterises A. It is easy to see that 



(AE (vi) +E (ll) A T ) 



Id 




for k = I = i, 

for k = i and k =/= I, 

for I = i and k ^ I, 

otherwise. 



Thus AE^ uniquely characterises the ith column of A and, hence, {AB'"' }j=i,...,d 
uniquely characterises A. □ 

Lemma 3.2. Let A : S<j — > §d be a linear operator and assume that there exists an e > 
and a function D : [0, e[-> M d (R) such that e At Z = D(t)ZD(t) T for all t G [0,e[ and Z G 
§d- r/ien i/iere exists an e> 0, a continuously differ entiable function D: [0,e[— > Md(K) 
and a unique matrix A G Md(R) ,s«c/i i/iai e X = D(t)X D(t) T for all t G [0,e[ and 
X G §d and suc/i tfiai AX = AX + li T /or a// X G § d . 

Proof. We first show the existence of a matrix D{t) with the stated properties. Observe 
that we obtain as a side result that, provided (exp(Ai)iJ( 11 ^)n ^ 0, the operator exp(At) 
is already fully identified by the values exp(At)E < - 11 ^ and exp{Ai)(E^> + E^' 1 ') with 
j = 2, 3, . . . , d and the fact that it can be represented as X i— > D(t)XD(t) T . 

Note that D(t)XD(t) T = {-D{t))X(-D(t)) T for all X G S d , so the matrix D(i) can 
only be unique up to a multiplication by minus one. Elementary calculations give 



exp(At)E^^ D " Dll ° 21 Dll ° 31 D ^ D ^) ( 3.i) 

and 



exp(At)(£( lj '> + £^) 
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(3.2) 

D lj D 11 +D ll D lj D 1] D 21 + D 11 D 2j ••• D w Aa + D u 2V 

for j = 2, 3, . . . , d. Here Dki denotes Dki(t) for notational convenience and * repre- 
sents entries which arc of no interest in the following. It is easy to see that the above 
equations uniquely characterise the matrix D(t) up to the sign of Dn(t), as long as 

(exp(Ai)£< n >)ii=r>ii(*)V0. 

Since exp(A-O) is the identity on §<j and thus (exp(A-0)i?^ 11 - ) )ii = 1, the continuity of 
1 1 ► exp(Ai) ensures that there exists an e> with e < e such that (exp(At)i?^ 11 ' )n > 
for all t G [0,e[. Thus, it follows from (3.1) and (3.2) that D(t) G M d (R) defined by 



Dn(t) = y/(ex P (A.t)EW) n , (3.3) 

Dg(t) = ("P^)^ V for^2,3,...,d, (3.4) 
£>n(i) 

~ (cxp(At)(gW)+gW))ii , . 

J Dy(t) = ~ for j = 2,3,..., d, (3.5) 

2^11(1) 



A;(t) 



(exp(At)(S( 1 ^ +J5CJ 1 ))) li (exp(Ai)(£;( 1 J) + J B^' 1 ))) 11 (exp(At)£;( 11 )) ll 



D u (t) 2D n (t) 3 
for i,j = 2,3, . . . ,d (3.6) 



is well-defined for all t £ [0,e[ and satisfies 

exp(At)Z = D(t)ZD(t) T Vi G [0, e[ and Z G § d . 



The continuous differentiability of 1 1— > exp(At) and the one of the square root function 
onK+\{0} imply together with (3.3)-(3.6) and the strict positivity of (exp(A-i)£ , ( 11 ))n 
that the map [0,e[— » M d (R),t 1— > £?(i) is continuously differentiablc. 

Using the notion of total or Frechet derivatives (see [29] or [9], Section X.4, for a review 
in connection with matrix analysis) and denoting the linear operators on by L(E d ), it 
follows immediately from 

(X + H)Z(X + H) T = XZX T + XZH T + HZX T + HZH T VZ G § d 

for X, H G M d (R) that the map / : M d (R) -> L(S d ),X h-> /(X) with /(X)Z = XZX T for 
all Z G E>d is continuously differentiable and the derivative T>f(X) is given by the linear 
map M d (R)^>L(S d ),H^>Vf(X){H) with Vf{X){H)Z = XZH T + HZX T for Z G S d . 
Thus 

(A exp(Ai)) Z = Z = ©/(£(«)) (^(*)) Z 
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= D(t)Z (±D(t)j T + ZD(tf 

for alHe [0,e[ and ZeS d . 

Since ^exp(Ai) = exp(At)A, it follows that A = exp(— A.t)4r exp(At). Moreover, it 

is easy to see that D{t) G GL<j(M) and exp(At)" 1 Z = exp(-Ai)Z = D^)- 1 ZD(t)- T for 
Z € §d and hence 

az = b{t)- l (b{t)z(^-b(t)) +(^b{t))zb(t)Ab{t)-' 1 (3.7) 



dt J \dt 



d ~ A T ( ~, . id 



+ ^D(t)-i_iJ(t))z (3.8) 

for Z G §d and all t G [0,e[. As by construction .D(O) = I d , setting A = j^D(t)\ t= o 
concludes the proof now by noting that Proposition 3.1 ensures the uniqueness of 
A G MaCR). □ 



Using this result, we can now completely characterise the linear operators whose ex- 
ponential group maps the positive semidefinite matrices onto themselves, as desired. 

Theorem 3.3. Let dG N. Then the following holds: 

(i) A linear mapping A : §d — > satisfies c A *(§J) = for all t G R + , if and only if 
there exists a matrix A G M d (R) such that AX = AX + XA T for all X G S<j. 

(ii) A linear mapping A:S d ^E d satisfies e A * (§J) = for all tgR, if there exists 
ane>0 such that c A *(§+) = §+ for all t G [0, e{. 

Proof, (i) Note that all linear maps that map S^" onto itself are of the form X \— ► CXC T 
for some C G GL d (R) (cf. [24], Chapter 3, or the original article [33]). The "if" part 
follows by combining this with the fact that e At X = e At Xe A * for all X G §d and t G M + 
(see, e.g., [13], pp. 255 and 440). Regarding the "only if" part, this shows that there is 
a function D(t) : R -> M d (R) such that e At X = D(t)XD(t) T for all t G R and X G S d - 
Lemma 3.2 immediately concludes now. 

(ii) Follows immediately from Lemma 3.2 as well. □ 

S^" can be replaced by in the above result. Yet we cannot extend the result to the 
case e At (Sj) C§j, as there are linear operators C such that C(Sj) C §J which are not 
representable by X h-> CXC T for some C G M d (R) (cf. [11]). 



4. The stationary distribution 



In this section we first use the theory of operator sclf-dccomposability to analyse the 
absolute continuity properties of the stationary distribution and then show how to find 
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a driving Levy process for a given stationary distribution. Finally, we obtain that the 
stationary distribution - somewhat surprisingly - can be concentrated on Sj, although 
L is not a matrix subordinator. 

4.1. Operator self-decomposability and absolute continuity 

The stationary distributions of multivariate Ornstein-Uhlenbeck type processes are oper- 
ator self-decomposable (see [32]). The operator self-decomposable distributions (cf. [15] 
for a comprehensive treatment) form an important subclass of the infinitely divisible 
distributions and the definition adapted to our matrix case reads as follows: 

Definition ^.1. Let Q :Sd ^ Sd be a linear operator. A probability distribution /i on 
E>d is called operator self-decomposable with respect to the operator Q if there exists a 
probability distribution v t on Ed such that fi = (e^ 4 /^) * v t for all t G R + , where * denotes 
the usual convolution of probability measures. 

Remark 4-2. (i) v t is for all t £ R + infinitely divisible ([15], Theorem 3.3.5). 

(ii) Rephrasing the definition on the level of random variables, we call an S^-valued 
random variable X operator self-decomposable with respect to a linear operator Q : Sd — > 

Sd if there exists an Sj" -valued random variable Y t independent of X such that X = 
e Qt x + Yt for all teR+. 

For our Ornstcin -Uhlenbcck type processes in the positive semidefinite matrices we 
immediately have the following result: 

Proposition 4.3. The stationary distribution of the positive semidefinite OU type 
process £ is operator self-decomposable with respect to the operator A:Sd — * §>d,^ i— * 
AX + XA T . 

This observation allows us to use the well-established theory on operator self-decom- 
posable distributions to study further properties of our processes. We can now show that 
the stationary distribution always has a density (with respect to the Lebesgue measure) 
whenever the Levy measure of the driving Levy process has a non-degenerate (with 
respect to A) support. Note that by the Lebesgue measure As d on E>d we mean the image 
of the Lebesgue measure A ffi d ( d + i)/2 on R d ( d + 1 )/ 2 under vech : § d -> R d ( d + 1 )/ 2 i that is, 
Xs d (B) = A R d(d+i)/2(vech(£?)) for all Borel sets B c S d . 

Theorem 4.4. Assume that the support of the Levy measure vl 7^0 of the driving matrix 
subordinator L is contained in a linear subspace V C Sd, that the smallest A-invariant 
linear subspace of§d containing V is Sd itself and that Vl(W) = for every proper linear 
subspace W C V. 

Then the stationary distribution of the Ornstein-Uhlenbeck type process S is abso- 
lutely continuous with respect to the Lebesgue measure on Sd- Moreover, the stationary 
distribution Ps of S is concentrated on S^ + , that is Pj:(S^ + ) = 1. 
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Proof. This follows by a straightforward adaptation of [15], Proposition 3.8.6, or [37] to 
the S^-case and the fact that Ag d (§J \ = 0, which is shown in the next lemma. □ 

Observe that this result holds for OU type processes in § d in general, not only for 
positive semidefinite ones, and that the density can be characterised as the unique weak 
solution to a certain integro-differential equation (see [15], Theorem 3.8.10). 

Lemma 4.5. The Lebesgue measure on S d satisfies A Sd (§+ \ S++) = 0. 

Proof. It is clear that \ §J+ C {X G § rf : dct(A) = 0}. The determinant is a poly- 
nomial in the entries of X £ §<j. Hence, there exists a d(d + l)/2-variate polynomial 
p. K d(d+i)/2 guch that det(X) = P(vech(X)) and P is not identically zero. As a 
polynomial P is a real analytic function and the set of zeros of real analytical functions 
not identically zero has Lebesgue measure zero ([15], Lemma 3.8.4), we have 

\ Sd ({X G $ d : det(X) = 0}) = A Rd(d+1 , /2 (vech({X G S d : dct(A) = 0})) 

= A R d (t!+ i)/ 2 {{x G K <i ( d + 1 )/ 2 : p( x ) = 0}) = 0. □ 

The following is an immediate consequence of Theorem 4.4 which will be sufficient in 
most cases encountered in practice. 

Corollary 4.6. Assume that for every proper linear subspace V o/Sd the Levy measure 
vj, of the driving matrix subordinator satisfies vj,(V) = and that vj, ^ 0. 

Then the stationary distribution of the Ornstein-Uhlenbeck type process S is absolutely 
continuous with respect to the Lebesgue measure. Moreover, the stationary distribution 
Ps of E is concentrated on Sj" + ; that is, Pe(§J + ) = 1. 

A particular class of d x d matrix subordinators is given by the discrete part of the 
quadratic variation of a <i-dimcnsional Levy process. Let L thus be a Levy process in R d . 
Then the discrete part of the quadratic variation is given by 

[£,£]?:= ]T AL S (AL S ) T 

0<s<t 

and it is easy to see that ([L, L]j ) tS R+ is a matrix subordinator in §d with the Levy mea- 
sure given by i/rg £]„(£?)= J Rd lB(xx T )vi(dx) = vi({x :ra T G B}) where denotes the 

Levy measure of L. Note that v^r £i is obviously concentrated on the positive semidef- 
inite rank one matrices and has thus a rather degenerate support. Yet, under rather 
mild regularity conditions, the stationary distribution of a positive semidefinite OU type 
process S driven by [L,L]° is absolutely continuous. 

Proposition 4.7. Let L be a Levy process in M. d with Levy measure v^^O and assume 
that v L ({x : x T Zx = 0}) = for all Z G § d \ {0}. 
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Then the stationary distribution of the Ornstein-Uhlenbeck type process E driven by 
[L,Ly is absolutely continuous with respect to the Lebesgue measure. Moreover, the sta- 
tionary distribution P% of ' E is concentrated on §J + , that is, Ps(§J + ) = 1- 

Proof. Recall that S>d with the scalar product X, Y i— > tr(X T Y) is a Hilbert space and 
denote for a set H C §d its orthogonal complement (with respect to this scalar product) 
byH x . 

Let H now be a proper linear subspace of and Z £ H \ {0}. Then H C {Z}^. Hence, 
y [i>iY {H) < y [i>i? {{Z} x ) = v L {{x £ 6 {Z}^}) = ^({z e R d :tr(xx T Z) - 

x T Za; = 0}) = by assumption. 

Since v,^ £p is obviously true, the proposition is implied by Corollary 4.6. □ 

The following corollary is usually sufficient for applications: 

Corollary 4.8. Let L be a Levy process in M. d with Levy measure v^^{) and assume 
that is absolutely continuous with respect to the Lebesgue measure on M. d . 

Then the stationary distribution of the Ornstein-Uhlenbeck type process E driven by 
[L, is absolutely continuous with respect to the Lebesgue measure. Moreover, the sta- 
tionary distribution Ps of E is concentrated on §^" + , that is, Ps (§J + ) = 1 ■ 

Proof. Let Z £ S d \ {0}. Then the function R d -> R, x = (x 1 ,x 2 , x d ) T h-> x t Zx is a 
quadratic polynomial (in d variables) and thus a real analytic function not identically 
zero. The zeros of a real analytic function not identically zero form a set of Lebesgue 
measure zero (see, e.g., [15], Lemma 3.8.4). Hence, v^({x : x T Zx = 0}) = for all Z £ 
§d \ {0} and thus Proposition 4.7 concludes the proof. □ 

Furthermore, note that the result concerning the existence of an infinitely often dif- 
ferentiable density with all derivatives bounded given in [19], Proposition 3.31, is also 
immediately applicable to our positive semidefinite OU type processes when using the 
vech operator to transfer them to R d ^ d+1 -'/ 2 -valucd OU type processes. 

4.2. Finding a driving Levy process 

It is also possible to construct positive semidefinite OU type processes with a prescribed 
marginal stationary distribution. The result is a refined version of [1], Lemma 5.1, adapted 
to the matrix case focusing especially on matrix subordinators. "Differentiability" in the 
following means total or Frechet differentiability and "derivative" refers to the total 
derivative. Moreover, observe in the following that a probability distribution /i concen- 
trated on is infinitely divisible if and only if its characteristic function fi is of the 
form 

A(^)=exp(Ur( 7Al Z) + ^ (e itr ^)-l)^(dX)), Z£§ dl (4.1) 
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where 7^ G §J and is a Levy measure on Sd satisfying 

^(S d \S+)=0 and / ||X||i/ /i (dX)<oo. 

J\\X\\<\ 

This follows from [34], page 156, combined with arguments analogous to the ones in [30], 
Remark 24.9. 



Theorem 4.9. Let A : Sd — > §d be a linear operator such that there is an A G Mrf(M) with 
a(A) C (-00, 0) + iR satisfying AX = AX + XA T for all X G §<£. Furthermore, let /i 6e 
an operator self-decomposable (with respect to A) distribution on §J wi£/i associated 7^ 
and ^ M suc/i £/ia£ f^.ij ZioWs and let ip(Z) = log(/ s + e ltT ^ xZ ^ /j,(dx)), Z G §d> be its cumulant 

d 

transform (logarithm of the characteristic function ji). Assume that —A-f^ — r y l _ l A T G 
that tp(Z) is differ entiable for all Z ^0 with derivative Dtp(Z) and that 

, „ (-Dtl>(Z)(A T Z + ZA), for ZeS d \{0}, 
' \0, for Z = 0, 

is continuous at zero. Then fir, : Z t— > exp(ipL(Z)) is the characteristic function of an 
infinitely divisible distribution fir, on 

Let L be a matrix subordinator with characteristic function fj,L at time one. Then the 
positive semidefinite Ornstein-Uhlenbeck type process dS t = AT, t dt + dL t driven by L 
has stationary distribution \x. 



Proof. As the characteristic functions of infinitely divisible distributions have no zeros 
([30], Lemma 7.5), ip is well defined. The definition of operator self-decomposability 
implies together with Remark 4.2(i) that cxp(ip(Z)) / exp(i/j(e AT * Ze At )) is for all t G R+ 
the characteristic function of an infinitely divisible distribution. Hence the function 

Z^( CX p(^(Z))/exp(^(e ATt Ze At ))) 1/ * 

is for all t G K + the characteristic function of an infinitely divisible distribution. Since, 
obviously, 

MZ)-^(c ATt Zc At ) ,,„w„T 

— '-^-Dip(Z)(A T Z + ZA) ast^O 

for all Z G Sd, we have that (exp(V'(2'))/exp(^(e j4T *Ze j4 *))) :L /* — * exp(tp L (Z)) point-wise 
for all Z G Sd as t — > 0. The continuity of ip^ at zero shows that jlj, is a characteristic func- 
tion. fiL belongs to an infinitely divisible distribution on Sd, because infinite divisibility 
is preserved under weak convergence ([30], Lemma 7.8). 

Let (Lt)teR now be a Levy process with characteristic function fi^ at time one and 
assume that d£t = ASt dt + dLt is started at time zero with £0 being independent of 
(L t )tm and having distribution fi. Thus E t = e A *£ e AT * + J * e A ^~ s ^ dL s e AT(t ~ s) and wc 
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have from [28] (see also [31], [15], Lemma 3.6.4, or the review in [19], Section 2.2) that 
£(exp(itr(E t Z))) 

= fi(c ATt Zc At ) exp Qf Vi(e AT ^c As ) ds^) 

= fi{e ATt Ze At ) exp Qf -^(e^Ze^X^e^Ze^ + e ATg Ze As A) ds^j 

= fi(e ATt Ze At ) exp(^(Z) - ^(e ATt Ze At )) = (X(Z). 

Hence, E is stationary with stationary distribution /z. By [32], Theorem 4.2, it follows 
now that E(\og + ||i t || ) < oo. As the stationary distribution \i is concentrated on Sj~, \il 
has to be an infinitely divisible distribution on S^" and hence the Levy process L is a 
matrix subordinator. This can be seen in the following three steps: 

(i) Assume that the Levy measure vl was not concentrated on , that is, 
i/i(§d \ Sj) > 0. Then, using the results of Section 3, which imply for all s G K+ that 
e As xe A s G §J if and only if x G and (2.4) (which also holds in this general case), we 
have that 

/ I § d \§+( eASxeATs ) u L(dx)>U forallsGR+ 

and hence ^(Sd \ Sj) = / °° / Sd /g d ^ s +(e j4s a;e j4Ts )^L(da;) ds > 0, a contradiction. 

(ii) We have for any t* G K++ by (2.4) and (4.1) that 

** r 

As A 



JS 



+ 



e As xe A s \\ Al)u L (dx) < / (||x|| A l)ws(dar) < oo 



Choosing t* such that ||e y4s xe ATs || > ||x||/2 for all s G [0, t*] and x G S<z implies that 

* / (\\e A °xe AT s\\Al)Mte)> f I {{\\x\\/2)M) VL {dx) 
Js+ Jo JSJ 



= 2t* \\x\\ VL {Ax). 

JS,+ ,\\x\\<2 

Hence, J s + H^H^zXdx) < oo and therefore L is of finite variation. 

(iii) Combining (i) and (ii) implies that ji^ is of the form (4.1) with jl G §d- Yet, (2.3) 
implies that jl = —Aj^ — 7 M A T and thus 7l G by assumption. □ 



Remark 4-10. (a) Dip(Z) is for each Z G §d a linear operator from Sd to R. Since §d is a 
Hilbert space, the Riesz-Frechet theorem ensures that there exists a function : Sd — » Sd 
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with Dijj(Z)X = tr(D^{Z)X) for all X £ Sd- This gives an alternative representation of 
ipL above. 

(b) The condition — A-f^ — r y fJ ,A T G §J may appear superfluous at a first sight, since it 
obviously is always satisfied for d = 1. However, in general dimensions it need not hold. 
For example, for 

A= \-l/3 ~-2 3 ) and 7 "=(-2/3 ~T) 

wc have that 



°( A ) = {-§5 ± M^649} « {-0.043, -2.06}, 

tr(7 M ) = {8/3, 4/3}, but <r(-A 7|t - 7 ^ T ) = iW ± ^%/l30} « {7.56, -0.045}. 

If the condition is not satisfied, all assertions of the theorem remain valid except that 
then is not concentrated on S^" and L is a finite variation Levy process in 8^ with all 
jumps in S^" but a drift in \ 

(c) Choosing A and 7^ as in (b), setting 7^ = — A 7m — 7/J A T and choosing vl as some 
measure on satisfying ^l({0}) = and / s +(||a;|| A 1)vl{&x) < 00, immediately gives 
an OU type process in with stationary distribution concentrated on S^", which is, 
however, not driven by a matrix subordinator. 



5. The covariance structure of matrix subordinators 

A very important topic is the characterisation of the second order structure of matrix 
subordinators, that is, which positive semidefinite d 2 x d 2 matrices appear as covariance 
matrices of d x d matrix subordinators. Until now we have only been able to find a useful 
characterisation of the covariance matrices of two subclasses of matrix subordinators, 
viz. diagonal and special quadratic variation matrix subordinators. 

The results obtained below provide insight into the specification and estimation of con- 
crete models in applications. For example, [25] considers a stochastic volatility model and 
estimates of the mean and covariance matrix of the driving diagonal matrix subordinator 
of the positive semidefinite OU type stochastic volatility process. For such an estima- 
tion procedure we completely characterise the range of possible values for the estimators 
below. 
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5.1. Diagonal matrix subordinators 

Let L\, L2, ■ ■ . , Ld be d univariate Levy subordinators forming together a d-dimcnsional 
Levy process. Then the process 

°\ 


L d J 

is a matrix subordinator with non-zero elements only on the diagonal. Such matrix sub- 
ordinators are referred to as diagonal matrix subordinators in the following. Obviously, all 
information about L, in particular the second order structure, is already contained in the 
diagonal ((L M ,L 2 ,i, . . . , £d,t) T )teK+ ■ It should be noted that ((Xi, t , L 2 , t , ■ ■ ■ , ^d,t) T )teR+ 
is increasing in the usual order of the cone and so the d-dimensional Levy process 

((Li t, ^2,tj ■ ■ ■ , £d,t) T )teR+ is a generalisation of the notion of a subordinator to the space 
K d . In the following we call a d-dimensional Levy processes with all components being 
univariate subordinators a multivariate subordinator. 

For the analysis of the second order structure of multivariate subordinators (and thus 
of diagonal matrix subordinators) we need the following notions from linear algebra, 
referring to [7, 8, 36] and the references therein for further details. 

Definition 5.1. A matrix A G Md(K) is called completely positive if there exist a k G N 
and a B G M<j fc(R) with all entries being non-negative such that A = BB T . 

A matrix A G M<j(R) is called doubly non-negative if A is positive semidefinite and all 
entries are non-negative. 

Obviously any completely positive matrix is doubly non-negative. 

Proposition 5.2. (a) If L is a d-dimensional multivariate subordinator with finite sec- 
ond moments, var(Li) is completely positive. 

(b) If C G Md(R) is completely positive, there exists a d-dimensional multivariate sub- 
ordinator L such that C = var(Li). 

(c) For C G Md(M.) there exists a d-dimensional multivariate subordinator L with 
var(ii) = C if and only if C is completely positive. 

(d) Provided d < 4, there exists a d-dimensional multivariate subordinator L with 
var(Li) — C if and only if C G M<j(K) is doubly non-negative. 

Proof. Regarding part (a) observe that var(Li) = J Rd xx T Vz J (dx) (cf. [30], page 163) 
and that the Levy measure vj, of L is necessarily concentrated on (R + ) d . Thus approx- 
imating Jm+y xx^-v^dx) by a sequence of integrals of simple functions (f n )nen of the 

form f n (x) = J2i=i x i,nxJ n lA i:ll { x ) w ^ appropriate Xi, n G (R + ) d and A;.„ C (M + ) d con- 
verging to x i— » xx T gives that var(Li) is the limit of a sequence of completely positive 



/Li •• 
L 2 '• 

\ ■■■ 
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matrices using [8], Proposition 2.2. Since the set of completely positive matrices is closed 
(cf. [8], Theorem 2.2), this implies that var(Li) is completely positive. 

For part (b) let k £ N and B £ M^fcQR) with only non- negative entries be such that C = 
BB T . Let further (£i.t)tgR+ with i = 1, 2, . . . , k be k independent univariate subordinators 
with finite second moments and var(Li) = Ik where Lt = (X<i,t, i^t, . . . ,Lk.t) T for t £ 
K + . Then L := (i?L t ) tgK + is a d-dimensional multivariate subordinator with var(Li) = 
BB T = C. 

Combining (a) and (b) gives (c) and, finally, (d) follows from (c), because for d < 4 
a matrix is doubly non- negative if and only if it is completely positive (cf. [21] or [8], 
Theorem 2.4). □ 

Part (d) provides a very nice complete characterisation of the covariance matrices of 
multivariate subordinators for d < 4. However, it does not extend to higher dimensions, 
since for dimensions five and greater there exist examples of doubly non-negative matrices 
that are not completely positive (see, e.g., [7]). In general dimensions it should thus be 
noted that there are easy-to-check, sufficient conditions for complete positivity, but the 
necessary and sufficient conditions known until now are more involved (cf. [36]). 

To conclude this discussion of the second order properties of multivariate subordina- 
tors, we now strengthen part (b) of the last theorem by also considering the expected 
value. 

Proposition 5.3. Let C £ M^R) be completely positive and fi£R d have only strictly 
positive entries. Then there exists a d- dimensional multivariate subordinator L such that 
E(L\) = fi and var(Li) = C . 

Proof. W.l.o.g. assume C^O. (In the case C = 0, simply take L as the deterministic 
Levy process with drift /i.) Let k £ N and B £ Md,kQ&) with only non-negative entries 
be such that C — BB T . Denote by e <G K fe the vector (1,1,..., 1) T and set 

X. mi„ and r-*", 

i=i,2,...,d\ (Be), J 2 

where the wcll-dcfincdncss of the minimum follows from C^O. Defining now = \i — 
0.5A-Be the choice of A ensures that has only strictly positive entries. 

Let further (ij,t)teK+ with i = 1, 2, . . ., k be k independent univariate compound Pois- 
son processes with rate r and the jump distribution being the exponential distribution 
with parameter A. Define a fc-dimcnsional Levy process L by L t = (Li t t,L2 t t, ■ ■ ■ ,Lk.t) T 
for t £ R + . Then elementary calculations imply E{L\) = 0.5Ae and var(Li) = h- 

Hence, defining L by L t = ^jjt + BL t for t £ K + concludes the proof. □ 

For a general matrix subordinator L we know that 

var(vec(Li)) = / vec(a;) vec(a;) T ^i(da;), 

M 
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but this does not seem to have any nice linear algebraic implications. Yet, the diagonal 
of any matrix subordinator forms a multivariate subordinator, so that the above results 
allow us at least to characterise the second order structure of the diagonal elements. 



5.2. Normal mixture quadratic variation matrix subordinators 

In this section we establish that for two special classes of quadratic variation matrix 
subordinators, which are special normal mixtures and hence in particular have elliptical 
distributions, one gets a particularly nice second order structure because only very well- 
understood matrices are involved. 

Let us assume for a moment that L is a <i-dimensional compound Poisson process with 
rate one and the jump distribution being the <i-dimcnsional normal distribution with 
mean zero and covariance matrix C € 8^ . This implies that the discontinuous part of the 
quadratic variation [L,L]°, which is given by 

[L,L]* = AL S (AL S ) T Vt€R + , 

0<s<t 

is a compound Poisson process with rate one where the jump distribution is a Wishart 
distribution. Then, denoting the d-dimensional normal distribution with vanishing mean 
and variance C by Nc(dx) and noting that vec(a;a; T ) vec(xa; T ) T = (x (g) x)(x' T <8> x T ) = 
(xx T ) ® (xx T ) we have 

E([L,L}\) = [ xx T v L {dx) = I xx T N c {dx)=C, (5.1) 
Jwi d Js. d 

var(vec([L,L]i)) = / vec(cca; T ) vec(xx T ) T v L {dx) = / (xx T ) <g> (xx T )N c (dx) (5.2) 



{C 1 ' 2 ®^/ 2 ) / {xx T )®{xx T )N Id {dx){C 1 ' 2 ®C 1 / 2 ) 



= (C 1/2 ®C 1/2 )(I d 2 + K d + vec(I d )vec(I d ) T )(C 1/2 ®C 1/2 ) 

= C<Z>C + K d (C®C)+vcc(C)vcc(C) T (5.3) 

from [18], Theorems 4.1 and 3.2(xii). Here K d £ M d 2(M.) denotes the commutation matrix 
which can be characterised by K d vcc(A) = vec(A T ) for all A £ Md(K) (see [18] for more 
details). This can be easily generalised to the following result: 

Proposition 5.4. Let L be a d- dimensional compound Poisson process with rate r and 
the jumps being distributed like (eCY^X where X is a d-dimensional standard normal 
random variable, C € and e is a random variable in M + with finite variance and 
independent of X . Then 

E([L,L]*)=rE(e)C, (5.4) 
var(vec([L, L}\)) = rE{e 2 ){C ®C + K d (C <E>C)+ vec(C*) vec(C) T ). (5.5) 
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Moving away from a Levy process of finite activity, a similar result holds for the following 
variant of type G processes. Again, they correspond to a special kind of a normal mixture 
law such that infinite divisibility is ensured. 

Definition 5.5 (Type G). Let L be a d- dimensional Levy process. Lf there exists an 
M + -valued infinitely divisible random variable e independent of a d-dimensional standard 

normal random variable X and a matrix C G §J such that L\ = (eC) 1 / 2 X , then L is 
said to be of type G. (Here = denotes equality in law.) 

We have chosen the term "type G" above because these processes correspond to a 
particular case of multG laws as defined in [2], Definition 3.1. Actually, many interesting 
Levy processes arc of type G; for instance, the multivariate non-skewed and centred 
generalised hyperbolic (or normal inverse Gaussian) ones (cf. [10, 26]). For details on 
distributions/Levy processes of type G in general, we refer to [2, 17] and the references 
therein. 



Proposition 5.6. Let L be a d-dimensional Levy process of type G with a finite fourth 
moment. Then 

E([L,L]\)=E(e)C, (5.6) 
var(vec([L, £]?)) = var(e)(C ® C + K d (C ® C) + vec(C) vec(C) T ). (5.7) 

Proof. Let e be as in the definition of type G and v e be its Levy measure. Then by 
[2], Remark 3.1, L has Levy measure vl(&x) = J R + N t q (da;) v e {dr) and the finiteness of 
the fourth moment of L implies that E{e 2 ) < oo (unless C = 0, which is a trivial case). 
Hence, 

E([L,L]\)= / xx T v L {dx)= I I xx T N tC (&x)v £ (At) 

JR d il+ JR d 



C [ TV e {&T)=E{£)C, 
JR+ 



var(vec([L,L]J)) = / (xx T ) <g> (xx T )is L (dx) = / / (xx T ) <g> (xx T )N rC (dx)is e (dT) 

JR+ JR d 

T 2 v e {&T){C <E>C + K d (C ®C)+ vcc(C) vec(C*) T ) 

= var(e)(C ® C + K d (C <E>C)+ vec(C) vec(C) T ) 

using [18], Theorem 4.3, and noting that J R+ rf e (dr) exists, because e is infinitely divis- 
ible and concentrated on R + (cf. [30]). □ 

Remark 5.7. In the set-up of Proposition 5.6 C and i?(e),var(e) cannot be identified 
from the first and second moment of [L,L] D . However, they are identified as soon as one 
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fixes the scale of either C or e, for example, by demanding E(e) = 1, p(C) = 1, j|C|| = 1 
or det(C) = 1. 

Likewise, in the set-up of Proposition 5.4 one cannot identify C, E(e), E(e 2 ) and the 
rate r unless one fixes the scale of two of C,e and r. 

Finally, let us consider a concrete example, viz. when L is a d-dimensional centred 
and non-skewed generalised hyperbolic (GH) or normal inversion Gaussian Levy (NIG) 
process (see [5, 10, 20, 26] for a comprehensive list of references regarding the univariate 
case). Note that the NIG Levy processes form a subclass of the GH ones by fixing the 
parameter v = —1/2. The processes belonging to this subclass are highly tractable. Let 
L be a GH(z/, a, 0, 0, 5, C) Levy process with v£R, a, 6 £ M ++ and C £ Sj", that is, the 
location parameter [i and the skewness parameter (3 are fixed to zero. Furthermore, let 
e be a generalised inverse Gaussian GIG(i^, 8, a) random variable (see [14]) independent 
of a d-dimensional standard normal variable X, then 

Li = {eC) 1/2 X 

and so L is clearly type G. From [14], page 13, or [5], Lemma 4, we obtain 

_ 6 K y+1 {5a) _ S 2 K u+2 {6a)K„{6a) - K y+1 {5a) 2 

where if„ is the modified Bessel function of the third kind and order v (see, e.g., [12, 
35]), which can be defined via K v {z) = \ J °° y^-^e-^y+v' 1 )/^ dy for z £ R++ . Hence, we 
obtain completely explicit representations for E([L,L]\) and var(vec([L, L}\)) in (5.6) 
and (5.7). If L is actually an NIG Levy process the representations simplify further, 
because in this case 

E{e) = -, var(e) = -^ 

using that K v {z) = K^ v (z) and K 3 / 2 (z) = K 1 / 2 (z)(l + z^ 1 ). 

Usually one assumes det(C) = 1 in applications to make the parameters of the GH 
(NIG) distribution identified. We have opted not to make this assumption, because the 
above results are also of interest for degenerate GH Levy processes in which C is not 
invertiblc. 
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